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(54) Multi-media communication apparatus 

(57) A multi-media communication apparatus for 
communicating with a communication partner by using 
various kinds of media including image, voice and data. 
The communication apparatus has a memory for storing 
information on a communication on each medium, and 
forms and outputs a report for communication manage- 
ment from information on each communication. The 
communication management report can be formed 
manually or automatically and contains communication 
history along with images for identification of communi- 
cation partners. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 5 

This invention relates to a multi-media communica- 
tion apparatus for performing communication by using a 
combination of various kinds of media such as image, 
speech (audio), data (code data) and, more particularly, 
to a multi-media communication apparatus capable of 
outputting a communication management report con- 
taining communication information on communication 
partners, media used for communication and the like. 

Re lat ed Pa ckgrpund AH 

Conventionally, in facsimile apparatuses for image 
communication, information on the times when commu- 
nications are performed, the names of communication 
partners and so on is stored in a memory and this infor- 
mation is output as a communication management 
report by an instruction from the operator. 

Recently, a communication service using the Inte- 
grated Service Digital Network (ISDN) has been put to 
practical use. Audio-visual services using a digital line 
such as that of the ISDN therefore attract attention and 
the use of multi-media communication apparatuses 
such as TV telephone sets and TV meeting systems 
capable of communication using multiple media includ- 
ing images, voice and code data is spreading. 

In conventional multi-media communication appa- 
ratus of this kind, communication management is not 
performed and no communication management report 
is formed and output. It is therefore difficult to confirm 
the time when a communication is performed, the name 
of the communication partner and media used for the 
communication. 

SUMMARY OF THE INVENTION 

In view of the above problem, an object of the 
present invention is to provide a multi-media communi- 
cation apparatus capable of forming and outputting a 
communication management report, whereby commu- 
nication charges and communication history can be 
used for communication management. 

Another object of the present invention is to provide 
a multi-media communication apparatus in which com- 
munication history is recorded with respect to media 
such as image, voice and data and output as a report to 
enable communication conditions and changes with 
respect to the media to be easily recognized. 

Still another object of the present invention is to 
provide a multi-media communication apparatus which 
enables media used for communications to be easily 
recognized with respect to the communications. 

A further object of the present invention is to pro- 
vide a multi-media communication apparatus capable of 



outputting a communication management report by 
using as a parameter a medium used for communica- 
tion as a parameter. 

A still further object of the present invention is to 
provide a multi-media communication apparatus capa- 
ble of forming and outputting a communication manage- 
ment report by combining communication history data 
and partner's image data. 

A still further object of the present invention is to 
provide a multi-media communication apparatus which 
enables the operator to store a partner's image to be 
recorded on a communication report without being con- 
scious of this operation as well as to store and record an 
arbitrary partner's image on a communication report. 

A still further object of the present invention is to 
provide a multi-media communication apparatus which 
ensures that a communication management report can 
be output without failure and which enables the operator 
to output a communication management report any 
time. 

A still further object of the present invention is to 
provide a multi -media communication apparatus which 
enables identification of a communication partner in a 
case where incoming from the communication partner 
is received during operator's absence. 

The above and other objects of the present inven- 
tion will become apparent from the following detailed 
description given in conjunction with the accompanying 
drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of the construction of a 
multi-media communication apparatus in accord- 
ance with a first embodiment of the present inven- 
tion; 

Figs. 2 and 3 are flow charts of a process for com- 
munication in accordance with the first embodi- 
ment; 

Fig. 4 is a diagram of communication management 

information registered in a memory in accordance 

with the first embodiment; 

Fig. 5 is a flow chart of a procedure of control at the 

time of outputting a communication management 

report; 

Fig. 6 is a diagram of examples of communication 
managements in accordance with the first embodi- 
ment; 

Rg. 7 is a flow chart of the operation of storing com- 
munication history in accordance with a second 
embodiment; 

Rg. 8 is a diagram of contents of a memory in 
accordance with the second embodiment; 
Rg. 9 is a flow chart of report outputting in accord- 
ance with second embodiment; 
Rg. 10 is a diagram of examples of output commu- 
nication management reports in accordance with 
the second embodiment; 

Rg. 1 1 is a block diagram of the construction of a 
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multi-media communication apparatus in accord- 
ance with a third embodiment of the present inven- 
tion; 

Fig. 12 is a flow chart of a procedure of processing 
for communication in accordance with the third s 
embodiment; 

Fig. 13 is a flow chart of a procedure of control at 
the time of storing a partner's image in a memory; 
Fig. 14 is a flow chart of report outputting in accord- 
ance with the third embodiment; 10 
Fig. 15 is a diagram of memory contents in accord- 
ance with the third embodiment; and 
Fig. 16 is a diagram of an example of an output 
communication management report in accordance 
with the third embodiment. is 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[First Embodiment] 20 

First, an example of a system for outputting reports 
as communication results with respect to a several 
kinds of media, i.e., voice (audio), data and image in 
accordance with a first embodiment of the present 25 
invention will be described below. 

Fig. 1 is a block diagram of a multi-media communi- 
cation apparatus 1 in accordance with this embodiment. 
The multi-media communication apparatus 1 has a 
handset 2 provided as a voice (audio) input/output 30 
means and connected to a voice (audio) control section 
3. The voice control section 3 has a voice (audio) 
encoding/decoding section for encoding various voice 
(audio) signals to be transmitted and for decoding 
received voice signals, an on/off-hook detection section 35 
for detecting whether the handset 2 is in an on-hook 
state or in an off-hook state, and a voice interface sec- 
tion for generating various tones including a dial tone, 
call tone, a busy tone and an incoming tone. A data ter- 
minal 4 for data communication is connected to a data 40 
control section 5 which is arranged to perform data 
transmission/reception with the data terminal 4. A cam- 
era 6 is provided as an image input means. A display 
unit 7 displays an input image supplied from the camera 
6, an image received through a line 14, operation dis- 45 
play windows and the like. The camera 6 and the display 
unit 7 are connected to an image (video) control unit 8. 
The image control unit 8 has an image encoding/decod- 
ing section for encoding image signals to be transmitted 
and for decoding received image signals, and a video so 
interface section for changing or dividing display win- 
dows of the display section 7. An operation unit 9 having 
a keyboard, a touch panel or the like for inputting for 
overall control of the apparatus 1 is connected to a sys- 
tem control unit 10. The system control unit 10 has a 55 
CPU 101. a ROM 102, a RAM 103 and an auxiliary 
memory 104 and serves to control and observe the 
whole of the apparatus 1 or execute various application 
programs. The system control unit 10 incorporates, as 



described later, memory means (RAM 103, auxiliary 
memory 104) for collecting and storing communication 
history with respect to each medium, and a formation 
means (CPU 101) for forming a communication man- 
agement report on a management of communication on 
each medium based on the communication history col- 
lected and stored. An output unit (output means) 1 1 for 
outputting communication management reports formed 
by the system control unit 10 is connected to the system 
control unit 10. The voice control unit 3, the data control 
unit 5, the image control unit 8 and the display unit 7 are 
respectively connected to the system control unit 10. 
The voice control unit 3, the data control unit 5 and the 
image control unit 8 are respectively connected to a 
multiplex/separator unit 12. The multiplex/separator unit 
12 multiplexes a voice signal supplied from the voice 
control unit 3, data from the data control unit 5 and an 
image signal from the image control unit 8 and sepa- 
rates reception frames received through the line 14 with 
respect to the media. The multiplex/separator unit 12 is 
connected to a line interface unit 13 for controlling the 
line in accordance with the ISDN user network interface. 
The line interface unit 13 is connected to the ISDN 
through the line 14. 

A procedure of communication history processing 
at the time of communication (transmission or recep- 
tion) effected in the thus-constructed multi -media com- 
munication apparatus 1 will be described below with 
reference to the flow chart of Fig. 2. Communication his- 
tory is first collected by the system control unit 1 0 in step 
S1 , and the collected communication history is stored in 
the auxiliary storage 104 in step S2. Communication 
history referred to herein includes information items, 
e.g., communication numbers, communication times, 
periods of time for communication, communication part- 
ner terminal numbers, abbreviations of the names of 
partner terminals, used media and communication 
charge. 

Fig. 3 shows details of the flow chart of Fig. 2 and 
Fig. 4 shows the content of information stored in the 
memory 1 04. 

In step S21 , the system control unit 10 monitors to 
determine whether or not calling or incoming through 
the line interface unit 13 has occurred. If there is no call- 
ing or incoming, this step is repeated until calling or 
incoming takes place. If there is a calling or incoming, 
the process proceeds to step S22 and a transmis- 
sion/reception number, used media, a partner's tele- 
phone number and an abbreviated partner's name are 
stored in the memory 104 as shown in Fig. 4. In the 
operation of step S22, information on each medium is 
stored if a plurality of mediums are used. 

In step S23, determination is made as to whether or 
not the contents of all used media have been registered 
in the memory 104. The process proceeds to step S24 
if they have been registered, or returns to step S22 if 
they have not been registered. 

That is, in a case where both voice and image 
media are used for communication with the partner, the 
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communication contents are stored in the memory while 
separating the used media in accordance with the 
media categories, image and voice. 

In the case of ISDN communication, calling and 
incoming is effected through channel D (control chan- 
nel) and information on the partner's telephone number 
and the abbreviated partner's name is sent through 
channel D. In step S24, the system control unit 10 mon- 
itors to determine whether or not communication 
through a channel B (information channel) has actually 
been started. If No, step S24 is repeated until communi- 
cation is started. If Yes, the process proceeds to step 
S25 and the start time is stored in the memory 104. 

In step S26, the system control unit 10 monitors to 
determine whether or not communication through chan- 
nel B has been completed. If No, step S26 is repeated 
until the communication is completed. If Yes, the proc- 
ess proceeds to step S27 and the period of time for 
communication and a communication charge are stored 
in the memory 104. In the case of ISDN communication, 
communication termination is controlled through chan- 
nel D and information on communication charge is sent 
through channel D. 

Start times and communication periods are stored 
with respect to communications of the same communi- 
cation number, and communication charges are stored 
with respect to media based on the notification through 
channel D, as shown in Fig. 4. 

Next, a procedure for outputting communication 
reports in response to an instruction sent from the oper- 
ation unit 9 by an operator will be described below with 
reference to the flow chart of Fig. 5. 

If outputting communication reports is requested, 
the system control unit 10 determines in step S3 as to 
whether or not the whole communication history has 
been processed to form a communication management 
report with respect to each medium. If No, processing 
for forming communication management reports on 
non-processed communication history is performed in 
steps S5, S6, and S7. Communication reports formed in 
these steps enable management of communication on 
each medium. In step S5, communications on voice 
media are extracted from the memory 104 and process- 
ing for forming a voice communication management 
report is effected. In step S6, communications on data 
media are extracted from the memory 104 and process- 
ing for forming a data communication management 
report is effected. In step S7, communications on image 
media are extracted from the memory 1 04 and process- 
ing for forming an image communication management 
report is effected. The process thereafter returns to step 
S3. 

If Yes in step S3, that is, the whole processing his- 
tory has been processed to form communication man- 
agement reports, communication management reports 
on management with respect to media are output from 
the output unit 1 1 in step S4, and the process is termi- 
nated. Fig. 6 shows examples of output communication 
management reports. 



In the above-described embodiment, the operation 
of grouping communication management reports with 
respect to media is performed at the time of formation of 
communication management reports. However, this is 

5 not exclusive and this operation may be performed at 
the time of collection/storage of communication history. 

The format of output communication reports in 
accordance with the present invention is not limited. 
Communication management reports may be output 

10 separately with respect to media as in the case of the 
described embodiment, or the communication reports 
may be output in a format without being separated with 
respect to media such that management can be per- 
formed collectively with respect to all media. 

75 In the above-described embodiment, media are 
grouped into three categories: image, voice and data. 
However, "voice" can be sorted into sub divisions, for 
example, speech, 3.1 kHz audio, and 7 kHz audio. Also, 
"image" can be sorted variously, for example, it is sorted 

20 into animated image and still image. 

As described above, the multi-media communica- 
tion apparatus in accordance with the present invention 
is characterized by including memory means for collect- 
ing and storing communication history with respect to 

25 communication on each medium, a formation means for 
forming a communication management report on man- 
agement with respect to each medium, and an output 
means for outputting communication management 
reports formed by the formation means. 

30 A communication management report on manage- 
ment with respect to each medium is thereby automati- 
cally formed and output, thereby enabling management 
of communication charge such that the overall commu- 
nication cost and the communication cost with respect 

35 to each medium are calculated. 

According to the present invention, past communi- 
cation history can easily be referred to and it is therefore 
possible to improve the facility with which communica- 
tion is performed. 

40 In a case where a caretaking function is provided, 
incoming during operator's absence can be recorded by 
outputting a communication management report 

[Second Embodiment] 

45 

Next, an example of outputting a communication 
report with respect to media used for communication 
with the partner's communication apparatus in accord- 
ance with a second embodiment of the present inven- 

so Won will be described below. It is possible to set seven 
modes of using media: a first mode in which three 
media, voice, data and image, are used; a second mode 
in which two media, voice and data, are used; a third 
mode in which two media, voice and image, are used; a 

55 fourth mode in which two media, data and image, are 
used; a fifth mode in which only voice is used; a sixth 
mode in which only data is used; and a seventh mode in 
which image is used. 

Fig. 7 shows a process of storing communication 



4 



7 



EP 0 809 411 A1 



8 



history in accordance with the second embodiment, and 
Fig. 8 shows a state of storage in memory 104. 

In step S31, system control unit 10 monitors to 
determine whether or not any calling or incoming 
through line interface unit 13 has occurred. If there is no 
calling or incoming, this step is repeated until calling or 
incoming takes place. If there is a calling or incoming, 
the process proceeds to step S32 and a transmis- 
sion/reception number, used media, a partner's tele- 
phone number and an abbreviated partner's name are 
stored in memory 104. 

If the used mediums are voice and image, "1 " is first 
written in cells "voice" and "image" for used media, as 
shown in Fig. 8. (In cells for used media "data", the con- 
tent is changed from "0" to "1" by subsequently adding 
data by communication.) 

In step S33, system control unit 10 monitors to 
determine whether or not communication through chan- 
nel B (information channel) has actually been started. If 
No, step S33 is repeated until communication is started. 
If Yes, the process proceeds to step S34 and the start 
times with respect to voice and image are stored in 
memory 104. 

In step S35. system control unit 10 monitors to 
determine whether or not communication through chan- 
nel B has been completed. If No, the process proceeds 
to step S36 to determine whether or not the communi- 
cation mode has been changed. If the communication 
mode has been changed, the process returns to step 
S32. If "data" is added to communication media, the 
content in the cell for used medium "data" is changed to 
"1" and the data transmission start time is stored (Fig. 
8), in steps S32 to S34. 

When the communication is completed, the proc- 
ess proceeds to step S37 to store in memory 104 the 
media mode determined from the media used last, the 
periods of time for communication and communication 
charges, thereby completing the process. In the case of 
ISDN, communication termination is controlled through 
channel D and information on communication charge is 
sent through channel D. 

Fig. 9 shows a flow chart for report outputting. After 
report outputting has been requested, determination is 
made in step S41 as to whether or not a mode number 
input from the operator has been received. In the case 
of No, the process proceeds to step S44 to edit a report 
for each mode number. That is, information with respect 
all the mode numbers, such as information in mode 1 
and information in mode 2, is edited. In step S43, the 
reports are output in order of the mode numbers. 

Fig. 10 shows examples of output reports edited 
from the memory contents shown in Fig. 8. 

If it is determined in step S41 that a mode number 
has been input after the report output request, the proc- 
ess proceeds to step S42 to edit a report with respect to 
the input mode number. In step S34, the report with 
respect to the input mode number is output. That is, if 
"1" is input as a mode number, reports on communica- 
tions using three media, voice, data and image, is out- 



put. 

Thus, in the second embodiment, a communication 
report formed for each medium for communication can 
be output and it is possible to easily confirm the medium 

5 used for one-time communication, the communication 
period and the communication charge with respect to 
each medium. 

Further, according to the second embodiment, it is 
also possible to recognize media at least available for 

10 the partner's apparatus. For example, a report with 
respect to mode 1 is output, terminals capable of three 
kinds of communication using voice, data and image. 

[Third Embodiment] 

15 

An example of outputting a communication man- 
agement report with a received image in accordance 
with a third embodiment of the present invention will be 
described below. 

20 Fig. 1 1 is a block diagram of a multi-media commu- 
nication apparatus 101 in accordance with the third 
embodiment. The multi-media communication appara- 
tus 101 includes a handset 102 provided as a voice 
(audio) input/output means, and a voice control section 

25 103 having a voice (audio) encoding/decoding section 
for encoding various voice (audio) signals to be trans- 
mitted and for decoding received voice signals, an 
on/off-hook detection section, and a voice (audio) inter- 
face section for generating various tones. 

30 The apparatus 101 also includes a data terminal 
104 for data communication, a data control section 5 
arranged to perform data transmission/reception with 
the data terminal 104, a camera 106 provided as an 
image (video) input means, a display unit 107 for dis- 

35 playing an input image supplied from the camera 106, 
an image received through a line 115, operation display 
windows and the like, and an image (video) control unit 
108 having an image (video) encoding/decoding section 
for encoding image (video) signals to be transmitted 

40 and for decoding received image signals, and a video 
interface section for changing or dividing display win- 
dows of the display section 7. 

The apparatus 101 further includes an operation 
unit 109 having a keyboard, a touch panel or the like for 

45 inputting for overall control of the apparatus 101 , a sys- 
tem control unit 110 having a CPU 110a, a ROM 1 10b, 
a RAM 1 10c and a memory (not shown) and serving to 
control and observe the whole of the apparatus 101 or 
to execute various application programs, and a memory 

so unit (memory means) 1 1 1 for storing communication 
history and a communication partner's image proc- 
essed by the image control unit 108. 

In the system control unit 1 10, communication his- 
tory is collected at the time of communication, the com- 

55 munication history is stored in the memory 1 1 1 along 
with the received partner's image, and a communication 
management with the partner's image is formed and is 
output by the output unit (output means) 112. Thus, the 
system control unit 1 1 0 has a formation means for form- 
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ing a management report. 

The apparatus 101 further includes a multiplex/sep- 
arator unit 113 for multiplexing a voice signal from the 
voice control unit 103, data from the data control unit 
1 05 and an image signal from the image control unit 1 08 5 
and for separating reception frames received through 
the line 115 with respect to media, a line interface unit 
1 14 for controlling the line in accordance with the ISDN 
user network interface, and a line 1 15 for connection to 
the ISDN. 10 

A process of storing communication history and a 
partner's image effected for each communication by the 
thus-constructed multi-media communication apparatus 
will be described below with reference to the flow chart 
of Fig. 12. 15 

In step S51 , the system control unit 1 10 monitors to 
determine whether or not calling or incoming through 
the line interface unit 114 has occurred. If there is no 
calling or incoming, step S51 is repeated until calling or 
incoming takes place. If there is a calling or incoming, 20 
the process proceeds to step S52 and a transmis- 
sion/reception number, used media, a partner's tele- 
phone number and an abbreviated partner's name are 
stored in the memory 111. 

In the case of ISDN communication, calling and 25 
incoming is effected through channel D (control chan- 
nel) and information on the partner's telephone number 
and the abbreviated partner's name is sent through 
channel D. In step S53, the system control unit 110 
monitors to determine whether or not communication 30 
through channel B (information channel) has actually 
been started. If No, step S53 is repeated until communi- 
cation is started. If Yes, the process proceeds to step 
S54 and the start time is stored in the memory 111. 

In step S55, the partner's image sent from the other 35 
end of the line is stored. That is, it is processed by the 
image control unit 108 and is thereafter stored in the 
memory 111. 

In step S56, the system control unit 1 10 monitors to 
determine whether or not communication through chan- 40 
nel B has been completed. If No, step S56 is repeated 
until the communication is completed. If Yes, the proc- 
ess proceeds to step S57 and the period of time for 
communication and a communication charge are stored 
in the memory 1 1 1 . In the case of ISDN communication, 45 
communication termination is controlled through chan- 
nel D and information on communication charge is sent 
through channel D. 

Communication history and partner's images are 
stored in the memory 1 1 1 by this communication his- so 
tory/partner's image storing process, as shown in Fig. 
1 5. That is, communication history data 111-1 including 
communication numbers, used media, partner's tele- 
phone numbers, abbreviated partner's names, (commu- 
nication) start times, communication periods and 55 
communication charges is stored in a table form such 
as that shown in an upper section of Fig. 15, while part- 
ner's image data 1 1 1-2 is stored in a block form shown 
in a lower section of Fig. 5. 



The operation of storing a partner's image in step 
S55 will be described below based on the flow chart of 
Fig. 13. 

The operation unit 109 is provided with a memory 
key 109a (first operation means) for manually storing a 
received partner's image. In step S61 , determination is 
made as to whether or not the memory key 109a of the 
operation unit 109 has been depressed. If No, the proc- 
ess proceeds to step S62. The system control unit 110 
has a time monitoring means for automatically storing a 
partner's image, whereby, in step S62, determination is 
made as to whether or not a certain length of time has 
elapsed after the start of communication. If No, the 
process returns to step S61 and the above determina- 
tion operation is repeated. 

It is determined in step S61 that the momory key 
109a has been depressed, or it is determined in step 
S62 that the certain length of time has elapsed, the 
process proceeds to step S63 and the partner's image 
sent from the other end of the line is processed by the 
image control unit 108 and is thereafter stored in the 
memory 111, thereby completing the process. 

Next, a process of forming a communication man- 
agement report based on the communication history 
data 111-1 and partner's image data 111-2 stored in the 
memory 111 as shown in Fig. 14 and outputting the 
report will be described below based on the flow chart of 
Fig. 4. 

The operation unit 109 is provided with a report key 
109b (second operation means) for manually starting 
formation of a communication management report and 
outputting the formed report. In step S61 , determination 
is made as to whether or not the report key 109b of the 
operation unit 109 has been depressed. If No, the proc- 
ess proceeds to step S62 and determination is made as 
to whether or not calling or incoming takes place in the 
line interface unit 1 14. If it is thereby determined that no 
calling or incoming takes place, the process returns to 
step S61 and the above determination operation is 
repeated. 

If it is determined in step S62 that calling or incom- 
ing has taken place, the process proceeds to step S63 
and the communication history and the partner's image 
are stored as in steps S52 to S57 of Fig. 12. 

The system control unit 1 10 is provided with a com- 
munication number management means for automati- 
cally outputting a communication management report, 
whereby, in step S64, determination is made as to 
whether or not the number of communications has 
reached a predetermined number. If No, the process 
returns to step S61. 

If it is determined in step S61 that the report key 
109b has been depressed or it is determined in step 
S64 that the predetermined number of communications 
has been reached, the process proceeds to step S65 to 
form a communication management report. In this case, 
communication history data 111-1 and partner's image 
data 111-2 stored in the memory 1 1 1 as shown in Fig. 
15 are combined in accordance with the standard for- 
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mat with respect to each communication to form a com- 
munication management containing the partner's 
image, such as that shown in Fig. 16. In step S66, the 
communication mangement report formed in step S65 
is output by the output unit 12, thereby completing the 
process. 

In this embodiment, communication numbers, used 
media, partner's telephone numbers, abbreviated part- 
ner's names, (communication) start times, communica- 
tion periods and communication charges are included 
as items of communication history. However, other com- 
munication history items, e.g., communication modes, 
speech, 3.1 kHz audio, and 7 kHz audio, and communi- 
cation error codes may be used as information for com- 
munication management reports. 

Ordinarily, partner's images output in communica- 
tion management reports are still images. However, 
images used the multi-media communication apparatus 
are not limited to still images and may include animated 
images. If an animated image is used, it is converted 
into a still image in the multi-media communication 
apparatus after being sent from the partner's apparatus. 

In the above-described embodiment, the number of 
partner's image storing time is limited to one. However, 
partner's images may be stored a plurality of times by 
depressing the memory key 109a. 

The above-described embodiment is limited to the 
process of actual communication. However, the multi- 
media communication apparatus in accordance with the 
present invention may have a caretaking function such 
that the above-described process is automatically con- 
ducted for incoming during operator's absence. 

As described above, the multi-media communica- 
tion apparatus in accordance with the above embodi- 
ment is arranged to output a communication 
management report with a partner's image, thereby 
making it possible to easily refer to past communication 
history. Since communication partner's face or the like is 
added to the communication history, it is possible to 
identify the communication partners and the communi- 
cation times easily and positively. 

In the multi-media communication apparatus in 
accordance with the above embodiment, a partner's 
image can be stored automatically or manually. It is 
thereby possible for the operator to store the partner's 
image to be recorded on a communication report with- 
out being conscious of this operation as well as to store 
and record an arbitrary partner's image on a communi- 
cation report. 

In the multi-media communication apparatus in 
accordance with the above embodiment, a communica- 
tion management report can be formed by combining 
communication history data and partner's image data. 

In the multi-media communication apparatus in 
accordance with the above embodiment, the operation 
of outputting a communication management report can 
be started automatically or manually. It is therefore pos- 
sible for the operator to output communication manage- 
ment reports without failure and to output them at any 



time. 

Further, the multi-media communication apparatus 
in accordance with the above embodiment has an auto- 
matic response function (caretaking function) such that 

s a communication management report with a partner's 
image is output in the case of incoming during opera- 
tor's absence, thereby providing an incoming record 
containing an image of the partner's face. It is thereby 
possible to easily and positively identify the terminal 

io from which the incoming is received. 

Claims 

1. A multi-media communication apparatus compris- 
15 ing: 

communication means (3, 5, 8, 12, 13) for a 
communication with a partner's communication 
apparatus on each of kinds of media including 
20 video signal, voice and data; 

memory means (103) for storing information on 
each communication; 

formation means (101) for forming a communi- 
cation management report (Fig. 10) containing 

25 the information on each communication stored 

by said memory means; and 
output means (1 1) for outputting the communi- 
cation management report formed by said for- 
mation means, characterized in that 

30 said formation means (101) forms the commu- 

nication management report (Fig. 10) in such a 
form as an operator can understand a plurality 
of media information used in one communica- 
tion. 

35 

2. An apparatus according to Claim 1, wherein the 
communication management report outputted by 
said output means (11) describes the plurality of 
media information used in one communication. 

40 

3. An apparatus according to Claim 1, further com- 
prising designation means (9) for designating out- 
putting of the communication management report, 
and 

45 wherein said output means (11) outputs the 

communication management report in accordance 
with the designation by said designation means (9). 

4. An apparatus according to Claim 3, wherein said 
so formation means (101) forms the communication 

management report by using, as a parameter, at 
least one of the media which can be used for com- 
munication by said communication means. 

55 5. A multi-media communication method comprising: 

a communication step (S31, S33, S35) of per- 
forming a communication with a partner's com- 
munication apparatus on each of kinds of 
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media including video signal, voice and data; 
a storage step (S32) of storing information on 
each communication; 

a formation step (S42, S44) of forming a com- 
munication management report (Fig. 10) con- 
taining the information on each communication 
stored in said storage step; and 
an output step (S43) of outputting the commu- 
nication management report formed in said for- 
mation step, characterized in that 
said formation step (S42, S44) forms the com- 
munication management report (Fig. 10) in 
such a form as an operator can understand a 
plurality of media information used in one com- 
munication. 
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